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We numerically study finite-dimensional spin glasses at low and zero temperature, finding ev- 
idences for (i) strong time/space heterogeneities, (ii) spontaneous time scale separation and (iii) 
power law distributions of flipping times. Using zero temperature dynamics we study blocking, 
clustering and persistence phenomena. 



The study of non-equilibrium dynamics in quenched 
spin systems provides a rigorous and numerical test 
ground for modeling glassy behavior. Among the open 
issues which arise in this context there is the connec- 
tion between spatial and temporal heterogeneities and 
the global off-equilibrium dynamical features character- 
istic of glassy structures such as aging [Q. In the last 
decade, much progress has been made in the study of do- 
main evolution and aging in both ordered and disordered 
systems [^-^. In particular, the mean-field picture of the 
glassy transition |^J^ plays a central role in interpreting 
results of numerical simulations on spin systems, but it 
can not account for heterogeneities. On the other hand 
a set of interesting numerical and analytical results on 
the off-equilibrium dynamics in non-frustrated systems 
have been obtained [Q-^ , which can be now extended to 
frustrated ones. 

The scope of this study is to provide a further link 
between the different aspects of the glassy transition un- 
folded by the various approaches. More specifically, we 
shall focus on models with discrete (±J) couplings in 
2 and 3 dimensions. Of particular interest is the onset 
of time scale separation in the low temperature (low T) 
regime and its connections with the blocking and persis- 
tence phenomena in the zero-temperature (T = 0) limit. 

The choice of discrete couplings stems from the fact 
that they naturally arise as interactions incorporating ge- 
ometrical frustration and constraints. Moreover, models 
with discrete couplings are of central relevance in other 
areas such as combinatorial optimization and are known 
to provide very rich dynamical features even at T = [ p^ . 

In what follows, we report results from extensive nu- 
merical simulations concerning the following issues. 

I) The onset and the dependence on waiting time of 
the spontaneous time scale separation and space cluster- 
ing at sufficiently low T in 2D and 3D models. 

II) The related emergence at T = of the "blocking" 
phenomenon together with the clustering of a finite frac- 
tion of spins that flip infinitely often ( "fast" spins) , along 
with its interpretation in terms of the functional mean- 
field order parameter. 

III) The r = distributions of hipping times and fast 
spins clusters sizes. 

IV) The persistence phenomenon. 

Our studies focus on the ± J Edwards- Anderson (EA) 



model in 2 and 3 spatial dimensions (square and cubic 
lattices). The Hamiltonian of these models reads 
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where E is the set of lattice edges, the spins are of Ising 
type and the couplings take the values ±1 with equal 
probability. 

The study of 3D EA model in the very low tempera- 
ture region requires huge thermalization times and there- 
fore it has been severely limited by available computer 
resources. Only very recently these studies have been 
pushed to very low temperatures, thanks to the use of 
parallel computers |^ . The data presented in this letter 
referring to the 3D case has been obtained with the help 
of the APEIOO parallel computer Q. The 2D case is 
indeed much simpler in virtue of the existence of polyno- 
mial algorithms for ground-states calculations. 

It is known that in both 2D and 3D EA models 
lowering temperature produces a surprising increase in 
the number of high frequency flipping spins. Here we 
push the study of the flipping times distribution to the 
very low temperature region in the hard case of the 3D 
EA model. Moreover we investigate the dependence of 
this distribution on the waiting time, which is a relevant 
feature of the aging regime in glassy phases. 

According to the typical scheme used in off-equilibrium 
dynamical studies 0, we simulate large systems (of at 
least 32'^ spins) and we start the experiment with an in- 
stantaneous quench from infinite temperature to one in 
the glassy phase (T < Tc ~ 1.1). Next we let the sys- 
tem evolve for a waiting time (times are expressed in 
terms of Monte Carlo sweeps, MCS). Finally we calcu- 
late the flipping rates probability distribution function 
(pdf ) measuring the number of flips done by every spin 
within time windows extending from + t to tw + 2t, 
where t — 2'^ (with k < 26) is also the time window size. 
We simply define the mean hipping time t as the time 
window size divided by the number of flips and we con- 
struct the pdf of its logarithm, Pt.t^(lnr), by taking the 
histogram over all spins (with the label t identifying the 
time window). This distribution is expected to be self- 
averaging (like correlation functions) and so we prefer to 
simulate few very large samples. The choice of working 
with the ln(T) pdf instead of that for t is dictated by the 
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broadness of the latter. Note that a pure exponential tail 
in the former [P(lnT) oc e"^'""^] corresponds to a power 
law tail in the latter [P{t) oc 
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FIG. 1. Flipping times pdf show a spontaneous time scales 
separation as temperature is decreased. In the inset we 
present the pdf of the scaling variable nn(r) 

In the tw = case we find, as expected, that Ptfi{\nT) 
does not depend on t and so we consider only the pdf 
measured during the last time window, which has the 
largest support (more than 10^ MCS) and the highest 
statistics. In Fig. |l| we show such a distribution for dif- 
ferent temperatures. While at very high temperatures 
the pdf is strongly peaked around the mean, it acquires 
very large tails approaching the glass transition temper- 
ature and finally develops a clear bimodal shape at 
very low temperatures, as can be seen in Fig. (note 
the logarithmic scale on the y axis) . The emergence of a 
spontaneous time scales separation, allows us to naturally 
divide the spins into two very general classes: the "fast" 
spins belonging to the left peak and the "slow" ones to 
the right peak. While the shape of the left part of the 
distribution does not change with temperature, the posi- 
tion of the "slow" peak is clearly moving towards higher 
values when the temperature is decreased. As shown in 
the inset of Fig. |l|, this process verify the simple scal- 
ing nn(r), commonly found in every activated process 
in spin glasses. It follows that slow spins are the ones 
that have to overcome a barrier in order to flip, while the 
fast ones will eventually have a zero local field at some 
time (which could even happen very rarely). In the zero 
temperature limit we expect that the slow peak moves to- 
wards unreachable time-scales, whereas fast spins are the 
only responsible for the dynamics. The adjective "fast" 
could be somehow misleading, in turn their actual flip- 
ping times follow a very broad distribution. 

It is well known that in the aging regime two-times 
quantities depend on both times and not only on their 
difference. In the case of our Pt^t^ (In t) this dependence 
on the waiting time is shown in Fig. ||, where we present 
data for a low temperature (r = 0.35), a very large wait- 



ing time (tu, = 2^^) and many values of t. During the ag- 
ing process two different regimes can be identified : 
the quasi- equilibrium regime (t ^ tu,) where the system 
relaxes inside a quasi-state and the aging regime (t > tw) 
where macroscopic rearrangements take place. In these 
two regimes the shape of the Pt,t^(lnr) is different (this 
has been verified in many simulations with different 
values, even if here we report the results concerning only 
one waiting time). In Fig. |^ we display the pdf for dif- 
ferent choices of the ratio i/t^: the lowest curves corre- 
spond to the quasi-equilibrium regime, while the upper 
ones have values of t of the order of tw and therefore 
include the effects coming from the aging regime. 
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FIG. 2. T — 0.35 data has been measured on a 32'' sys- 
tem (10 samples) after waiting 2^* MCS. Different curves 
correspond to different time window sizes (from bottom) 
t = 2^^2",2^^2^^2^°,22^2^*. The last curve coincides 
with data presented in Fig.l. T = data have been measured 
on 100^ systems, after a waiting time of tw = 2^^, 2^*. 



It is clear that the time-scales separation is sharper 
in the quasi-equilibrium regime, while approaching the 
aging regime the gap between fast and slow peaks is par- 
tially filled. Observing that the slow spins create the 
environment where the fast spins move in (the so called 
cage effect), we may assume that the meta-stable state is 
identified by the spatial structure of slow spins which act 
as a rigid backbone on time scales typical of the quasi- 
equilibrium regime. Therefore we may also observe that 
the basic excitations that bring the system out of quasi- 
equilibrium are given by those spins which fill the gap 
between the peaks. The study of the spatial structure 
of these spins would help towards the understanding of 
basic excitation in 3D spin glasses. 

The same set of simulations with Gaussian couplings 
gives no evidence of a so simple time scale separation. 
In this case the distribution of microscopic time scales is 
different and much longer simulations would be needed 
in order to unveil the separation. Moreover at T = 
in the Gaussian case the system rapidly get stuck in a 
local minimum and its configuration is fully frozen, con- 
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sistently with the zero-temperature classification given 
in 1^. Only the ±J model has a rich aging behavior at 
zero temperature. 

In the T = limit activated processes disappear and 
the slow peak goes to infinity. Then the gap between the 
peaks can no longer be filled when the system leaves the 
quasi-equilibrium regime. In other words, the P(^(^(lnT) 
becomes <u,-independent (we have checked numerically 
this fact) and it describes only the fast spin component. 
Remarkably enough, the T = pdf is already present 
in the finite temperature data, in their quasi-equilibrium 
regime (see Fig. ^ and this would suggest that T = 
dynamical features could be present at low temperatures 
too, at least in the quasi-equilibrium regime. Hereafter 
we will consider only the following updating rule. A site 
is randomly chosen and it is oriented in the direction of 
the neighbors majority or at random if the local field on 
it is zero. 

We find that the T = flipping time distributions can 
be well fitted by a power law over many decades, with an 
exponent A + 1 = 1.76(2) in 3D and A + 1 = 2.08(3) in 
2D. This means that in 2D after a large but finite time 
(given by the average flipping time) an extensive frac- 
tion of the system can be flipped with zero-energy costs. 
On the contrary in 3D an average flipping time can not 
be defined and this divergence is maybe related to the 
existence of a finite temperature phase transition. 

Persistence Q is one the most studied properties of 
zero temperature dynamics , nevertheless it has been 
never measured in spin glasses. Here we fill this gap. 

The persistence U{t,tyj) is defined as the number of 
unfiipped spins in the time interval [t^ ,tw + t]. In 
pure ferromagnetic models (at least for D = 2, 3) the 
persistence U{t,tw) decays to zero, in the large times 
limit, as U{t,tw) oc {t/tw)~^^^\ the exponent being t^- 
independent. On the contrary, in disordered models the 
persistence is expected to remain finite § in the t oo 
limit and its asymptotic value Uao{tw) may depend on the 
waiting time. The physical mechanism underlying such 
effect is the slow freezing of a rigid component. It fol- 
lows that the proper way of estimating the persistence in 
disordered systems is by taking a sufficiently large value 
of tw, differently from what has been done in previous 
studies where the choice t^ = Q was used. 

In Fig. ^ we show the results for 3D ± J spin glasses 
(very similar results have been found in the 2D case). 
While the system relaxes towards the stationary state the 
number of frozen spins grows and Uryo{iw) monotonically 
increases with t^ . In the large times limit we can extract 
the 9 exponent from the decay U{t,t^) — Uoo{tw) oc t"^ . 
This fitting procedure is not an easy one, because of the 
slow persistence decay, and so our results are affected 
by large errors. Our best estimations are 9 = 0.46(3) 
and [/oo(oo) = 0.862(2) in 3D and 9 = 0.64(3) and 
[/^(oo) = 0.778(2) in 2D. The 9 value in 3D is confirmed 
by the local magnetizations pdf which can be well fitted 



by the law (1 — m^)^ ^ at low and zero temperatures. 

These numbers imply that in the large times limit a 
±J spin glass is not completely frozen. While a large 
fraction [/oo(cxd) of the spins get blocked forever, a finite 
fraction 1 — Uoo{oo) of the volume is composed by spins 
that fiip infinitely often , with their hipping times fol- 
lowing power law distributions. The fast spins produce 
the persistence phenomenon. 
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FIG. 3. Continuous lines show the persistence decay af- 
ter different waiting times in a 100^ spin glass. Dashed lines 
present the persistence in a microcanonical experiment, where 
the energy is kept constant after time t^. 

In Fig. H we report with dashed lines the results of a 
microcanonical experiment. As before, we let the system 
relax for tw MCS and then we measure the persistence. 
The difference is that now the dynamics after time tw is 
performed keeping the energy constant to the value it had 
at time tw For t < tw the data perfectly coincide with 
those for the usual persistence. Then the system leaves 
the configurational space region (state [|j) where it was 
confined by the dynamics and it goes far away (we check 
this also measuring correlations functions, that behave 
qualitatively like persistence) . Thus we can conclude that 
the freezing phenomenon is completely dynamical . In 
other words the system seems to be stuck only because it 
always finds a path towards a lower energy configuration 
belonging to the same state before finding a path towards 
a different state. 

For both dimensionalities we find that fast spins are 
organized in clusters. At any time and in each cluster 
there must be at least one "free" spin that can be flipped 
without any energy cost {AE < 0). The number of free 
spins equals the number of fiat directions in the config- 
uration space and decreases lowering the energy. Free 
spins usually appear in pairs, which wander inside their 
cluster 

Fast spins clusters sizes follow the pdf shown in Fig. |^. 
Measurements have been taken after a waiting time of 
t^, = 10^. Note that a finite can overestimate a little 
the clusters size, however for both dimensions we have 
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that C/oo(10^) is very near to [/oo(oo) and we did not find 
any dependence on tw . Up to our accuracy, 3D data can 
be well fitted by a power law with an exponent —1.94(3). 
On the contrary 2D data clearly show a cut-off. We can 
not exclude that also 3D data would show a cut-off on 
larger scales. 

1 I , , 1 

■ 3D data • — • 1 

' power law fit 

2D data x 
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FIG. 4. Fast spins clusters sizes pdf. 3D data have been 
collected in system of sizes 30^, 45^ and 100^, and with two 
different updating rules (sequential and random). The power 
law fit gives —1.94(3) as the best exponent. 2D data, mea- 
sured in a 1000^ system, clearly show a cut-off. 

For any finite cluster we can construct the set of al- 
lowed configurations and then we can evaluate the time 
a random walker needs to visit all of them. This time is, 
by construction, greater than the larger dipping time of 
any spin in the cluster. In this way we can link clusters 
sizes and flipping times, and one would expect to find a 
cut-off Tmax in the 2D distribution of flipping times as a 
consequence of the one present at Cmax in Fig. ^. How- 
ever times may be exponential in the cluster size (like 
e.g. the recurrence time) and Tmax may be considered in- 
finite for all practical purposes. Moreover, if one assume 
from percolation arguments that Cmax grows logarithmi- 
cally with the system size N, then Tmax would grow as a 
power of N, like usually in any finite size systems. 

In conclusion we have performed a numerical study 
of the low temperature dynamics of a finite-dimensional 
frustrated model with discrete couplings, namely the EA 
model in 2D and 3D, which can be viewed as a prototype 
model for glassy systems. The onset of a spontaneous 
time/space scale separation allows for a classification of 
spins in distinct classes characterized by their own dy- 
namics as well as the identification of low-energy excita- 
tion responsible for structural rearrangements during the 
aging. 

In the T = limit, while a part of the system com- 
pletely freeze, the fast spins dynamics can be quantita- 
tively described in terms of power law exponents which 
distinguish the 2D from the 3D case. The dynamics in- 
side a cluster of fast spins, although diffusive-like, has 
strong constraints and can be interpreted along the lines 



of 0. 

Given a proper definition of persistence in aging sys- 
tems, we have been able to estimate the persistence ex- 
ponent in the EA model, which turns out to be of kind 
M. Q, i.e. partially frozen and partially infinitely fiip- 
ping. Finally, with a microcanonical experiment, we have 
shown that blocking phenomena are completely dynam- 
ical, even in disordered systems. 

In spite of the central role played by space and time 
heterogeneities in glassy dynamics, such aspects have 
been rather poorly studied from the analytical point of 
view. Scope of this paper has been to provide some refer- 
ence numerical result which hopefully could be captured 
by theoretical arguments. A first step in this direction 
can be done within the framework of finitely connected 
long range models (like e.g. the Viana-Bray one jl^). In 
these models the underlying graph generates non trivial 
heterogeneities, driven by the connectivity pattern. 
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